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Introduction 


This document describes the model used to measure student growth for institutional 
accountability in New York State for the 2018/19 school year and how three years of student 
growth results were combined to generate a three-year growth measure called the Growth 
Index. The Growth Index was first used in 2017/18 to make accountability determinations. 


The New York State Education Department (NYSED) reports both unadjusted and adjusted 
growth scores. Unadjusted growth scores include only prior achievement as a predictor variable 
while adjusted growth scores control for prior achievement and student characteristics as 
predictor variables.t Unadjusted scores are reported for informational purposes to educators 
and are used for institutional accountability in Grades 4-8 to calculate the Growth Index. 


The Growth Index combines results from three years of growth models that yield growth scores 
for students, which are known as Student Growth Percentiles (SGP). In 2018/19, these growth 
models were implemented in Grades 4-8 ELA and mathematics and were based on assessing 
each student’s change in performance between 2017/18 (and prior years) and 2018/19 on 
State assessments compared with students who have similar prior performance.” For more 
information about how growth is used for institutional accountability purposes, see Measuring 
Student Growth for Institutional Accountability in New York (available here: 


http://www.p12.nysed.gov/accountability/essa.html). 


Content and Organization of This Report 

The results presented in this report are based on the 2018/19 student growth model and 
Growth Index results, with some comparison to prior-year results. This technical report 
contains four sections: 


1. Data-— Description of the data used to implement the student growth model, including 
data processing rules and relevant issues that arose during processing. 

2. Model — Description of the unadjusted statistical model. 

Reporting — Description of reporting metrics. 

4. Results — Overview of key model results aimed at providing information on model 
quality and characteristics. 


“ 


1 Details can be found in the 2018/19 Growth Model for Educator Evaluation Technical Report, which is available on 
the NYSED Growth Measures Toolkits page. 

2 For more information about the 2016/17 and 2017/18 growth models, which also contribute to the 2018/19 
Growth Index, see the Growth Model for Educator Evaluation 2016/17 Technical Report and the Growth Model for 
Educator Evaluation 2017/18 Technical Report which can be found in the Archived Resources of NYSED Growth 


Measures Toolkits page. 
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Data 


To measure student growth and attribute that growth to schools, at least two sources of data 
are required: student test scores that can be observed across time and information describing 
how students are linked to schools (i.e., identifying which school students attend for a tested 

subject). 


The following sections describe in more detail the data used for model estimation. 


Test Scores 

New York’s student growth models drew on test score data from statewide testing programs in 
Grades 3-8 in ELA and mathematics for schools of students in Grades 4-8. The Grades 4-8 
growth models are estimated separately by grade and subject using scores from each grade 
(e.g., Grade 5 mathematics) as the outcome. 


State Tests in ELA and Mathematics (Grades 3-8) 

The New York State Grades 3-8 State assessments measure a range of knowledge and skills in 
mathematics and ELA. State tests in ELA and mathematics for Grades 3-8 are given in the 
spring. In 2017/18, the Department conducted a standards review process because the Grades 
3-8 ELA and mathematics assessments were administered over the course of two days rather 
than over the course of three days as in previous years. Due to the State’s new two-session test 
design and performance standards, the 2018 and 2019 Grades 3-8 ELA and mathematics results 
are not directly comparable to prior-year results. While test scores cannot be compared to prior 
year scores, growth results may still be computed. 


The New York Grades 4-8 institutional accountability growth model uses test scores in each 
subject area as a predictor for that area. Specifically, New York’s Grades 4-8 institutional 
accountability growth model includes up to three prior year test scores (depending on the 
grade) in the same subject area. If the immediate prior-year test score in the same subject was 
missing from the immediate prior grade, the student was not included in the growth measure 
for that subject. Two examples of how students would not have growth scores computed for 
them are: 


1. Students without a prior-year test score (e.g., a 6" grade student with a valid 6" 
grade ELA test score in 2018/19 who did not have a valid ELA test score in 2017/18); 
or 

2. Students with a prior-year test score for the same grade as the current year test 
score (e.g., a 6'" grade student with a valid 6'* grade ELA test score in 2018/19 who 
also had a 6"" grade ELA test score in 2017/18). 
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Where applicable, missing data indicators were used for missing second and third year prior 
scores. These missing indicator variables allow the models to include students who do not have 
the maximum possible test history and mean that the model results measure outcomes for 
students with and without the maximum possible assessment history. This approach was taken 
to include as many students as possible. For the 2018/19 analyses, data from 2018/19 were 
used as outcomes, with prior achievement predictors coming from the previous three years 
(going back to 2015/16). The specific tests used as predictors vary by grade and subject and are 
as follows (see also Table 1): 


e Grade 4 ELA and mathematics models used scores from Grade 3 in ELA and 
mathematics. Students were NOT included if they lacked Grade 3 scores from the 
immediate prior year in the same subject. 

e Grade 5 ELA and mathematics models used scores from Grades 3 and 4 in ELA and 
mathematics. Students were NOT included if they lacked Grade 4 scores from the 
immediate prior year in the same subject. 

e Grades 6-8 ELA and mathematics models used up to three prior grade scores from 
Grades 3-7 in ELA and mathematics. Students were NOT included if they lacked the 
immediate prior-year score in the same subject (e.g., 2018/19 Grade 6 students must 
have had a Grade 5 score in the same subject from 2017/18). 


Table 1. Prior Year Same Subject Test Scores Included 
Prior Year Same Subject Test Scores Included in the Model 
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In addition to test scores, the New York Grades 4-8 institutional accountability growth model 
also used the conditional standard errors of measurement of those test scores. All assessments 
contain some amount of measurement error, and the New York Grades 4-8 institutional 
accountability growth model accounts for this error (as described in more detail in the Model 
section of this report). Conditional standard errors were obtained from published technical 
reports for the assessments’ prior-year test scores, and the State’s test vendor provided a 
similar table for the 2018/19 test scores. 
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School Attribution 

For the New York Grades 4-8 institutional accountability growth model, students were 
attributed to schools if they were continuously enrolled (i.e., enrolled in the same school on 
BEDS day and at the beginning of the State test administration in the spring). Table 2 shows 
attribution rates for schools for the 2018/19 model. 


Table 2. Grades 4-8 School-Student Attribution Rates (2018/19 Single Year Model) 
Valid Student Records Valid Student Records Attributed to Attribution Rate 
at Least One School 


4 318,410 309,887 

5 314,756 306,914 98% 

6 302,243 294,865 98% 

7 286,657 280,325 98% 

8 230,718 225,555 98% 
1,452,784 1,417,546 


Note: Student records are considered valid for the purposes of growth modeling when there are at least two 
consecutive years of valid assessment scores. Students can have as many as two valid records per year, one for ELA 
and one for mathematics. 


More student records overall were attributed to schools in 2018/19 than in 2017/18 or 
2016/17, and the attribution rate in 2018/19 (98%) was slightly higher than in 2017/18 and 
2016/17 (97%). 


Model 


This section describes the statistical model used to measure student growth between two 
points in time on a single subject of a State assessment. New York’s student growth model is 
run separately at the end of each school year and the resulting SGPs from the three most 
recent years are aggregated to create the Institutional Accountability Growth Index. This 
section describes the model used to create SGPs in the 2016/17, 2017/18, and 2018/19 school 
years and begins with a description of the statistical model used to form the comparison point 
against which students are measured, based on similar students. It then describes how SGPs 
are derived from the comparison point, followed by how the Growth Index is produced from 
these three years of SGPs. 


At the core of the New York State institutional accountability growth model is the production of 
an SGP. This statistic characterizes each student’s current year score relative to other students 
with similar prior test score histories. For example, an SGP equal to 75 denotes that a student’s 
current year growth score is the same as or better than 75% of the students in the State with 
prior test score histories and other measured characteristics that are similar. It does not mean 
that the student’s growth is better than that of 75% of all other students in the population. 
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One common approach to estimating SGPs is to use a quantile regression model (Betebenner, 
2009). This approach models the current year score as a function of prior test scores and finds 
the SGP by comparing the current year score to the predicted values at various quantiles of the 
conditional distribution. 


The methods described here do not rely on the quantile regression method for two reasons. 
First, the typical implementation of the quantile regression makes no correction for 
measurement variance in the predictor variables or the outcome variable. Ignoring the 
measurement variance in the predictor variables yields bias in the model coefficients (e.g., Wei 
and Carroll, 2009). Further complicating the issue, the measurement variance in the outcome 
variable also adds to the bias in a quantile regression (Hausman, 2001), an issue that does not 
occur with linear regression. 


A linear regression model is used to compute the SGPs each year for New York’s growth model 
and is designed to account for measurement variance in the predictor variables, as well as the 
outcome variable, to yield unbiased estimates of the model coefficients. Subsequently, these 
model coefficients are used to form a predicted score, which is ultimately the basis for the SGP. 
Because the prediction is based on the observed score, it is necessary to account for 
measurement variance in the prediction as well. Hence, the model accounts for measurement 
variance in two steps: first in the model estimation and second in forming the prediction. The 
next section describes this model in detail. 


Covariate Adjustment Model 

The statistical model implemented as the growth model is typically referred to as a covariate 
adjustment model (McCaffrey, Lockwood, Koretz, & Hamilton, 2004), as the current year 
observed score is conditioned on prior levels of student achievement as well as other possible 
covariates. 


In its most general form, the model can be represented as follows: 


L 
yi = ». Ve-riVt-r T ej 
r=1 


where y;; is the observed score at time t for student i, y;_, is the observed lag score at time 
t—r(r€ {1,2,...,L}) and y is the coefficient vector capturing the effects of lagged scores. 


Accounting for Measurement Variance in the Predictor Variables 

All test scores are measured with variance, and the magnitude of the variance varies across the 
range of test scores. The standard errors (square roots of variances) of measurement are 
referred to as conditional standard errors of measurement (CSEMs) because the variance of a 
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score is heteroscedastic and depends on the score itself. Figure 1 shows a sample from the 
2018/19 Grade 8 ELA test in New York. 


Figure 1. Conditional Standard Error of Measurement Plot (Grade 8 ELA, 2018/19) 
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Treating the observed scores as if they were the true scores introduces a bias in the regression 
that cannot be ignored within the context of a high-stakes accountability system (Greene, 
2003). In test theory, the observed score is described as the sum of a true score plus an 
independent variance component, X = X* + U, where U is a matrix of unobserved 
disturbances with the same dimensions as X. 


Our estimator accounting for the error in the predictor variables is derived in a manner similar 
to that of Goldstein (1995). 


Specification for the Grades 4-8 Growth Model 

The preceding section provides details on the general modeling approach and specifically how 
measurement variance is accounted for in the model. The exact specification for the New York 
Grades 4-8 model in 2016/17, 2017/18, and 2018/19 is described as follows: 


K M 
Voi = Ut > BiVg-ri + ». TsMgj + E; 
l=1 s=1 


where yg; is the current year test scale score for student i in grade g, yu is the intercept, f; is 
the set of coefficients associated with the three prior test scores, T, is the set of coefficients 
associated with the missing variable indicators, and ¢; is the student residual. 


Student Growth Percentiles 
The previously described regression models yield unbiased estimates of the coefficients by 
accounting for the measurement error in the observed scores. The resulting estimates are then 
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used to form a student-level SGP statistic. For purposes of the growth model, a predicted value 
and its variance for each student are required to compute the SGPs as follows: 


SGP, = ® YiT Vi 


2 
: | Oy Fi 


where SGP, is the observed value of the outcome variable and 9; = w’d where w’ is the i“” row 
of the model matrix W, and the notation OS Fi is used to mean the variance of the predicted 
value of y for the i*” student. 


Here, the regression is of form 
y=Wort+e 
where 
e~N(0,07) 
For this case, the classic variance of a predictor is 
Ose, = [1+ wi (w'w)*wi]ee 
where G2 is the variance of the predictor. However, in this case, we make two refinements to 


acknowledge the effect of measurement error on the residual variance. The first is to use the 


actual variance on y;j, called OSir rather than the population variance on y,, called yin which is 
already included in @2. This is done by subtracting the population variance and adding back the 


individual variance. Thus, the variance on the predictor becomes 
a = =2 2 
Oye; = [1+ wi (w'w) twi|[o2 — a}. rig 


The second refinement is to replace the population variance in w,, called 2, with the individual 
variance in w;, called X;. This replacement is done in the same way as with the variance in y;, so 
the variance estimate is now 


Oye = [1 + wi(w'w)*wi][og — dy; — 6'E45] + of; + 5'E;6 


A predicted value for each student is used to compute the SGP. However, that prediction is 
based on the estimates of the fixed effects that were corrected for measurement variance but 
based on the observed score in vector w. 


Figure 2 illustrates how the SGPs are found from the previously described approach. The 
illustration considers only a single predictor variable, although the concept can be generalized 
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to multiple predictor variables, as presented earlier. For each student, we find a predicted value 
conditional on his or her observed prior scores and the model coefficients. To illustrate the 
concept, assume we find the prediction and its variance but do not account for the 
measurement variance in the observed scores used to form that prediction. We would form a 
conditional distribution around the predicted value and find the portion of the normal 
distribution that falls below the student’s observed score. This is equivalent to 


SGP; = [rene 


with fO)-N(S;, Oy fi) although this is readily accomplished using the cumulative normal 
distribution function, ®(-). 


Figure 2. Sample Growth Percentile from Model 
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Figure 3 illustrates the same hypothetical student shown in Figure 2. Note that the observed 
score and predicted value are identical. However, the prediction variance is larger than in 
Figure 2. As a result, when we integrate over the normal from —o to y,, the SGP is 60, not 90 


www.nysed.gov 11 


New York State Education Department 
2018/19 Growth Model for Institutional Accountability 
Technical Report 


as in the previous example. This difference occurs because the conditional density curve has 
become more spread out, reflecting less precision in the prediction. 


Figure 3. Sample Growth Percentile from Model 
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Combining SGPs Across Years to Generate a Growth Index 

Once SGPs are estimated for each student, school- and district-level statistics can be formed 
that characterize the typical performance of students within a group. New York’s growth model 
Technical Advisory Committee recommended using a mean SGP, or mean growth percentile 
(MGP). For accountability purposes, this three-year MGP is referred to as the Growth Index. 


For NYSED’s 2018/19 institutional accountability model, SGPs from 2016/17, 2017/18, and 
2018/19 were combined to create a Growth Index for each accountability subgroup for public 
schools, charter schools, and districts. To do so, three years of SGPs for continuously enrolled 


3 To be included in the Growth Index, a student must be continuously enrolled in a public school, charter school, or 
district that was open during the 2018/19 school year. 
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students were combined and a mean of SGPs was calculated for each accountability subgroup 
and for each school and district. 


For each aggregate unit (je{1,2, ..., /}), such as a school, the statistic of interest is a summary 
measure of growth for students within this group. Within group j, there are 

{SGPiay, SGPj(2), --- , SGP; yy}. That is, there is an observed SGP for each student for each year 
within group /. 


Then the Growth Index for unit j is produced as the simple mean 
6; = mean(SGPj1)) 


Many schools serve students from different grades and with results from different tested 
subjects. Because the SGPs are expressed as percentiles, they are free from scale-specific 
inferences and can be combined. Therefore, for the Growth Index, all SGPs of relevant students 
are pooled and the mean of the pooled SGPs is calculated. 


A Growth Index is calculated for the All Students group and each of the accountability 
subgroups for which the count of SGPs is greater than or equal to 30 for the three year period: 
American Indian or Alaska Native, Black of African American, Hispanic or Latino, Asian/Pacific 
Islander, White, Multiracial, Students with Disabilities, English Language Learners, and 
Economically Disadvantaged.* The Growth Index is then rounded to the nearest tenth decimal 
place and assigned to one of four Levels based on the cut points described in Table 3. Growth 
Index to Growth Level. 


Table 3. Growth Index to Growth Level 


Growth Index Growth Level 


45 or less 1 
45.1 to 50 2 
50.1 to 54 3 
Greater than 54 4 


4 When calculating the Growth Index for English language learners (ELLs), if there are 30 or more SGPs for the 
subgroup across the three years, then former ELLs are included in the Growth Index as the number of SGPs for 
former ELLs is less than half the number of ELLs in the current year. Former ELLs are students that were reported in 
at least one of the two previous reporting years but not in the current reporting year with a disability program 
service code. Similarly, if there are 30 or more SGPs for the Students with Disabilities subgroup, then former 
students with disabilities are included in the Growth Index. Former students with disabilities are students that 
were reported in at least one of the two previous reporting years but not in the current reporting year with a 
disability program service code. 
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Reporting 
Institutional accountability growth results are provided for all students and disaggregated by 
subgroup as well as the student roster file are provided to Districts and charter schools. 


Institutional Accountability Reports 
The main reporting metrics for schools of Grades 4-8 were as follows: 


e Sum of SGPs — The sum of the SGP results in ELA and in math for 2016/17, 2017/18, and 
2018/19. 

e Number of Student Scores — The number of SGP results in ELA and in math for 
continuously enrolled students for 2016/17, 2017/18, and 2018/19 

e Growth Index— The mean of the SGPs for students attributed to the subgroup. 

e Growth Level — The Growth Level associated with the reported Growth Index. 


Results are presented at an aggregate level for the district and its schools and students 
separately. 


Minimum Sample Sizes for Reporting 

To report a Growth Index, a subgroup requires at least 30 student scores across three years. 
Table 4 presents the percentage of schools and districts that had at least one student attributed 
between 2016/17 and 2018/19 and the number/percent included in the institutional 
accountability model after applying the n = 30 rule. 


Table 4. Grades 4-8 Reporting Rates (2018/19 Growth Index) 


Measure Number with at Number Meeting the Percentage Meeting 
Least One Student Minimum Sample Size the Minimum Sample 
P Nadal oleicete| Requirement Size Requirement 
2018/19 Growth School 3,522 3,499 99% 
Index (3-year District 717 714 100% 
MGP) 
Results 


This section provides an overview of the results for the single-year 2018/19 growth model 
estimation followed by the three-year Growth Index results. A pseudo R-squared statistic and 
summary statistics characterizing the SGPs, MGPs, and their precision provide an overview of 
model fit. 
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Single-Year 2018/19 Growth Model 

The Growth Index incorporates three years of growth scores from single-year models that are 
estimated separately for each grade and subject. In addition to being combined with 2016/17 
and 2017/18 results to contribute to the 2018/19 Growth Index, results of the 2018/19 single- 
year model were shared with schools and districts to show a one-year MGP for informational 
purposes only. The following results are related to the single-year 2018/19 growth model.° 


Model Fit Statistics for Grades 4-8 

The R-square value is a statistic commonly used to describe the goodness-of-fit for a regression 
model. Because the model implemented here is an error-in-variables (EiV)® model, not a least 
squares regression, we refer to this as a pseudo R-square. Table 5 presents the pseudo R-square 
values for each grade and subject, computed as the squared correlation between the fitted 
values and the outcome variable. 


Table 5. Grades 4-8 Unadjusted Model Pseudo R-Squared Values by Grade and Subject (2018/19 
Single Year Model) 


(eT ¢-Te(-) ELA Mathematics 
4 0.59 0.66 
5 0.66 0.71 
6 0.66 0.71 
7 0.70 0.70 
8 0.69 0.63 


Student Growth Percentiles for Grades 4-8 

SGPs describe a student’s current year score relative to those of other students in the data with 
similar prior academic histories and other measured characteristics. A student’s SGP should not 
be expected to be higher or lower based on his or her prior-year score. Table 6 shows the 
correlation between the prior-year scale score and SGP for each grade and subject. These 
correlations are usually negative as a result of using the EiV approach to account for 
measurement variance in the prior-year scale score; the correlation need not be zero. Squaring 
these values gives the percentage of variation in SGPs explained by prior-year scores for any 
grade and subject. Although prior-year test scores are generally good predictors of current year 
test scores, the prior-year test score is a poor predictor of current year SGPs. As shown in Table 
6, prior-year test scores explain about 3% to 6% of the variation in SGPs. Because SGPs are 


5 For more information about the 2016/17 and 2017/18 growth models, see the Archived Resources of NYSED 


Growth Measures Toolkits page. 
© EiV regression is a method to estimate consistent coefficients when variables are measured with error, such as 


assessment scores. EiV regression allows us to acknowledge and account for that error. 
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intended to allow students to show low or high growth no matter their prior performance, this 
result is as expected. 


Table 6. Grades 4-8 Unadjusted Model Correlation Between SGP and Prior-Year Scale Score 
(2018/19 Single Year Model) 


eT ¢-To (=) ELA Mathematics 
4 -0.207 -0.225 
5 -0.195 -0.170 
6 -0.179 -0.158 
7 -0.169 -0.248 
8 -0.157 -0.242 


Reliability of Unadjusted MGPs 
It is useful to examine the reliability statistic to assess the precision of the school-level MGPs, 
specified here as p: 


1. 49 
a 
" (aay) 
where @ is the mean standard error of the MGP, and sd (6;) is the standard deviation between 
school MGPs. In theory, the highest possible value is one, which would represent complete 


precision in the measure. When the ratio is zero, the variation in MGPs is explained entirely by 
sampling variation. Larger values of p are associated with more precisely measured MGPs. 


Table 7 provides the weighted mean standard errors, the weighted standard deviations, and 
the values of weighted p for the unadjusted model for schools, using the number of SGPs as 
weights. These results are based upon the one-year MGPs for the 2018/19 model. The values 
shown below are very similar to what was reported for the 2016/17 and 2017/18 models. 


Table 7. Grades 4-8 Weighted Unadjusted Model Mean Standard Errors, Standard Deviation, 
and Value of p by Grade for Schools, Weighted by Number of SGPs (2018/19 Single Year Model) 
Weighted Weighted Weighted 
Mean Standard Error Standard Deviation Reliability Statistic (9) 
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Table 8 provides the share of schools whose combined unadjusted MGPs are significantly above 
or below the State mean, using the 95% confidence intervals. In all cases, the percentage 
exceeding the mean is larger than what would be expected by chance alone, indicating the 
model distinguishes between schools (i.e., 2.5% of schools would be expected to be above or 
below the mean by chance alone). 


Table 8. Grades 4-8 Unadjusted Model School Combined MGPs Above or Below the Mean at a 
95% Confidence Level (2018/19 Single-Year Model) 
Below Mean Above Mean 


4 749 31% 552 23% 
5 620 26% 540 23% 
6 422 25% 548 33% 
7 394 27% 417 29% 
8 330 23% 390 27% 


Growth Index 


The following provides results of the Growth Index, which includes growth models for 2016/17, 
2017/18, and 2018/19. 


Neutrality of Growth Index 

It is helpful to consider the relationship between the Growth Index and school characteristics, 
to identify any relationships that suggest non-neutrality. The scatter plots in Figures 4 through 8 
provide a visual representation of the correlation between the school Growth Index and five 
school characteristics: the percent of students who are ELL, the percent of SWD, the percent of 
students in poverty or with economic disadvantage (ED), and the mean prior ELA or 
mathematics score of the students. 
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Figure 4. Growth Index Scores by Percentage of ELL Students in School 
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Figure 5. Growth Index Scores by Percentage of SWD Students in School 
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Figure 6. Growth Index Scores by Percentage of ED Students in School 
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Figures 7 and 8 show the relationship between the Growth Index and the Z-score of student 
prior achievement. A Z-score represents the number of standard deviations above or below the 
mean. Since the assessment scales are not designed to be averaged directly across grades or 
testing regimes, the Z-score provides a way to represent multiple grades and years of test 


scores together. 
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Figure 7. Growth Index Scores by Mean Prior ELA Z-Score Students in School 
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Figure 8. Growth Index Scores by Mean Prior Math Z-Score Students in School 
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The scatter plots above show that the Growth Index has a low to moderate correlation with 
respect to school demographic and pretest characteristics. The low correlation means that the 
Growth Index can be considered to be neutral with respect to these school characteristics and 
this neutrality means that schools can demonstrate growth, regardless of the academic starting 
point or characteristics of their students. 
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Growth Levels 

As noted above, for accountability purposes, the Growth Index is translated to a Growth 
Level. Table 9 describes the observed distribution of Growth Levels for schools and districts 
for the All Students subgroup based on their 2018/19 Growth Index score. 


Table 9. School and District Level Distributions 


Output Level Level 1 Level 2 WV =} ic} Level 4 
School 13% 34% 31% 22% 
District 8% 49% 36% 7% 


Note: Because of rounding, percentages may not add to 100 percent. 
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Appendix A. Model Coefficients 


The tables that follow display regression model coefficients (labeled as “Effects”) for the New 
York growth model in each grade and subject. For the Grades 4-8 model, these model 
coefficients represent the predicted change in current year test scores for one unit of change in 
each variable shown in the table, holding other variables constant. For example, in Table A 1, 
the predicted change in a student’s current year ELA test score given a one-point increase ina 
student’s prior grade ELA test score is 0.861. The interpretation of a one-unit change varies by 
variable type. For yes/no variables, model coefficients represent the predicted change in 
current year test scores given a change from no to yes. Missing flags are yes/no variables set to 
yes if the noted variable is missing and no otherwise. 


Because of the differences in model and variable types, it is important to keep in mind that 
effect sizes cannot be compared directly across different types of variables. 


Table A 1. Grade 4 ELA Unadjusted Model Coefficients 


Effect Name Effect Standard Error p-value 
Constant Term 82.236 1.163 0.000 
Prior-Grade ELA Scale Score 0.861 0.002 0.000 

Table A 2. Grade 5 ELA Unadjusted Model Coefficients 

Effect Name Effect Standard Error p-value 
Constant Term 115.105 1.868 0.000 
Prior-Grade ELA Scale Score 0.729 0.004 0.000 
Two-Grades-Prior ELA Scale Score 0.153 0.002 0.000 
Missing Flag: Two-Grades-Prior ELA Scale Score 46.008 0.700 0.000 


Table A 3. Grade 6 ELA Unadjusted Model Coefficients 


Effect Name Standard Error p-value 
Constant Term 99.725 2.122 0.000 
Prior-Grade ELA Scale Score 0.737 0.005 0.000 
Three-Grades-Prior ELA Scale Score 0.073 0.002 0.000 
Missing Flag: Three-Grades-Prior ELA Scale Score 22.922 0.753 0.000 
Two-Grades-Prior ELA Scale Score 0.110 0.003 0.000 
Missing Flag: Two-Grades-Prior ELA Scale Score 32.511 0.878 0.000 
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Table A 4. Grade 7 ELA Unadjusted Model Coefficients 


Effect Name Effect Standard Error p-value 
Constant Term 119.786 1.809 0.000 
Prior-Grade ELA Scale Score 0.723 0.004 0.000 
Three-Grades-Prior ELA Scale Score 0.069 0.002 0.000 
Missing Flag: Three-Grades-Prior ELA Scale Score 20.975 0.723 0.000 
Two-Grades-Prior ELA Scale Score 0.084 0.002 0.000 
Missing Flag: Two-Grades-Prior ELA Scale Score 23.935 0.696 0.000 
Table A 5. Grade 8 ELA Unadjusted Model Coefficients 
Effect Name Effect Standard Error p-value 
Constant Term 148.611 1.825 0.000 
Prior-Grade ELA Scale Score 0.685 0.004 0.000 
Three-Grades-Prior ELA Scale Score 0.037 0.002 0.000 
Missing Flag: Three-Grades-Prior ELA Scale Score 11.179 0.564 0.000 
Two-Grades-Prior ELA Scale Score 0.099 0.003 0.000 
Missing Flag: Two-Grades-Prior ELA Scale Score 27.894 0.733 0.000 
Table A 6. Grade 4 Mathematics Unadjusted Model Coefficients 
Effect Name Effect Standard Error p-value 
Constant Term 36.566 1.109 0.000 
Prior-Grade Mathematics Scale Score 0.940 0.002 0.000 
Table A 7. Grade 5 Mathematics Unadjusted Model Coefficients 
Effect Name Effect Standard Error p-value 
Constant Term 115.991 1.692 0.000 
Prior-Grade Mathematics Scale Score 0.750 0.004 0.000 
Two-Grades-Prior Mathematics Scale Score 0.113 0.002 0.000 
Missing Flag: Two-Grades-Prior Mathematics Scale Score 34.155 0.553 0.000 
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Effect Name Effect Standard Error p-value 
Constant Term 191.300 1.676 0.000 
Prior-Grade Mathematics Scale Score 0.597 0.004 0.000 
Three-Grades-Prior Mathematics Scale Score 0.053 0.002 0.000 
Missing Flag: Three-Grades-Prior Mathematics Scale Score 16.415 0.544 0.000 
Two-Grades-Prior Mathematics Scale Score 0.116 0.002 0.000 
Missing Flag: Two-Grades-Prior Mathematics Scale Score 34.122 0.610 0.000 

Table A 9. Grade 7 Mathematics Unadjusted Model Coefficients 

Effect Name Effect Standard Error p-value 
Constant Term 61.355 2.175 0.000 
Prior-Grade Mathematics Scale Score 0.861 0.005 0.000 
Three-Grades-Prior Mathematics Scale Score 0.023 0.002 0.000 
Missing Flag: Three-Grades-Prior Mathematics Scale Score 7.411 0.598 0.000 
Two-Grades-Prior Mathematics Scale Score 0.053 0.003 0.000 
Missing Flag: Two-Grades-Prior Mathematics Scale Score 15.736 0.778 0.000 

Table A 10. Grade 8 Mathematics Unadjusted Model Coefficients 

Effect Name Effect Standard Error p-value 
Constant Term 35.605 3.484 0.000 
Prior-Grade Mathematics Scale Score 0.917 0.007 0.000 
Three-Grades-Prior Mathematics Scale Score 0.000 0.003 0.972 
Missing Flag: Three-Grades-Prior Mathematics Scale Score 0.443 0.838 0.597 
Two-Grades-Prior Mathematics Scale Score 0.061 0.004 0.000 
Missing Flag: Two-Grades-Prior Mathematics Scale Score 17.919 1.064 0.000 
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